Updating Reduced Match Criteria for the Forest Restoration & Wildfire Risk Mitigation Grant

Author

Jude Bayham

Published

August, 2024

Introduction

In 2020, our research team at Colorado State University developed the Wildfire Social Vulnerability Index (WFSVI) in order to set a criteria for reduced match for the Forest Restoration & Wildfire Risk Mitigation (FRWRM) Grant. The data layer was updated in 2023 as described in this report. This report describes the 2024 updates to the WFSVI, which consists of updating the 5-year American Community Survey from (2017-2021) to (2018-2022). Additionally, we provide a version of the WFSVI that is not clipped to WUI only areas.

American Community Survey Update

The original WFSVI was built using 5-year (2016 - 2020) American Community Survey (ACS) estimates. We have updated the WFSVI using the most current 5-year (2018-2022) ACS data. In some cases, no data is reported for a census block group because of poor response to the ACS or insufficient sample size to meet data disclosure requirements. We use two methods to impute missing values. First, if the data is reported at the census tract1, we use the census tract data to fill any missing records. While these data may be less spatially accurate, they represent the next best estimate of the block group value. Second, we use a machine learning imputation model to complete missing records when tract level information is unavailable. The machine learning method is known as random forest and is implemented via missForest package in R. The random forest method uses nonmissing data for one variable to train a model based on other nonmissing variables from other block groups around the state and uses that model to estimate missing values. It applies this procedure to each variable and iteratively updates until the model converges on its best estimate (see the package documentation for more information).

Colorado EnviroScreen Data

Colorado’s Environmental Justice Act (HB21-1266) prompted the development of the EnviroScreen mapping tool to identify “disproportionately impacted communities”. We consider any disproportionately impacted community to automatically qualify for the FRWRM reduced match requirement. According to the EnviroScreen documentation, a disproportionately impacted community is defined as

… census block groups where more than 40% of the population are low-income (meaning that median household income is at or below 200% of the federal poverty line), 50% of the households are housing cost-burdened (meaning that a household spends more than 30% of its income on housing costs like rent or a mortgage), 40% of the population are people of color (including all people who do not identify as non-Hispanic white), or 20% of households are linguistically isolated (meaning that all members of a household that are 14 years old or older have difficulty with speaking English). Also included in this definition are mobile home communities, the Ute Mountain Ute and Southern Ute Indian Reservations, and all areas that qualify as disadvantaged in the federal Climate and Economic Justice Screening Tool. The definition also includes census block groups that experience higher rates of cumulative impacts, which is represented by an EnviroScreen Score (Percentile) above 80.

The CO EnviroScreen tool data was built using 5-year ACS data from 2015-2019 along with many other data sources. However, the current WFSVI is based on the 5-year ACS 2018-2022, which are based on census block groups redefined in 2020. Consequently, the CO EnviroScreen tool data cannot be directly merged with the WFSVI data. We use a geographic crosswalk designed to harmonize data across time (Manson et al., 2021). The crosswalk develops a set of weights based on the estimated fraction of the population or households in the 2010-2020 block group definition to the 2020 block group definition. We use the population weights to translate the following data between block group definitions: low-income, people of color, the cumulative impact score, and the Justice 40 criteria, and the household weights to map the housing burden and linguistic isolation criteria. We then apply the qualifying thresholds defined above to determine which of the 2020 block groups qualifies as a disproportionately impacted community.

The integration of the CO EnviroScreen tool aligns the WFSVI with HB21-1266 in Colorado and the federal Justice 40 initiative. Future versions of the WFSVI will include Colorado EnviroScreen 2.0, which is currently under development.

Updated WFSVI Layer

The 2024 update of the WFSVI layer differs from previous years in that it is not clipped to census block groups (CBG) that include WUI (like it was in previous years).

Method Update: Previous versions of the WFSVI calculate percent rank scores (i.e., percentile) for each index component using only the subset of CBGs with WUI (see report). The current version calculate percent rank scores for the index components using every CBG in the state. The percent rank is a relative metric and depends on the set of values a particular CBG is being compared. We implement this change in method to create a consistent WFSVI between the WUI-clipped and unclipped versions. Therefore, WFSVI scores, and thus CBGs qualifying for reduced match in FRWRM, may differ from last year because of changes in the American Community Survey data and the set of CBGs used to calculate the WFSVI.

Reduced Match Layer

The WFSVI is the layer with all Census Block Groups in Colorado and should be used for the FRWRM grant.

The interactive map shows census block groups that qualify for reduced match in yellow. The user can zoom into any location and click on block groups for more information. The popup contains the block group identifying number, the WFSVI value, the qualifying frequency (described in the 2023 report), whether it qualifies because of its “disproportionately impacted community” designation, and the value of each WFSVI component. The index is described in more detail in the original report. The WFSVI and its components are all displayed in percentiles of the distribution of all values in Colorado block groups. The higher the value, the more likely the block group is to qualify for the reduced match. The percentage reported for each index component represents the weight of the component in the overall WFSVI. Note that the percentages are rounded and may not add to 100%.

You can download spatial and non-spatial version of the layer containing the reduced match qualifying indicator here:

The following files include the indicator for reduced match and the underlying data:

For reference, the interactive map accessible here is the layer displayed above but clipped to the WUI layer.

The interactive map accessible here displays the census block groups by WFSVI index value and all of their components for all populated census block groups in Colorado. The colors correspond to deciles of the WFSVI index distribution

Comparing WFSVI, CO EnviroScreen, and Justice 40

We compare the WFSVI with the Colorado EnviroScreen and Federal Climate and Economic Justice (J40) layers. CO Enviroscreen and J40 layers were both designed to identify disadvantaged communities. While they are distict data products, their criteria overlap. The Justice40 layer is defined at the census tract and was created by the Council on Environmental Quality to identify communities experiencing eight categories of burden: climate change, energy, health, housing, legacy pollution, transportation, water and wastewater, and workforce development. CO EnviroScreen is defined at the Census Block Group and is designed to identify dispropotionately impacted communities (described in Section 3). Notably, CO EnviroScreen definition of disproportionately impacted communities includes any census tract identified as disadvantaged by the J40 layer.

The following tables show the number of census block groups that qualify under each of the three criteria: WFSVI, CO EnviroScreen, and Justice 40. Table A compares the WFSVI with CO EnviroScreen. Table B compares the WFSVI with J40. Table C compares CO EnviroScreen with J40. Figure 1 compares the number of CBGs designated as disporportionately impacted communities (CO EnviroScreen), disadvantaged communities (J40), and the upper 75th percentile of WFSVI.

Table A shows the correspondents between WFSVI and CO EnviroScreen. The upper left cell (2,176) and lower right cell (851) show the agreement between the two metrics, whereas the lower left cell (153) and upper right (842) show disagreement. The WFSVI and CO EnviroScreen designate 75% of CBGs similarly. This overlap is relatively high given that the intent of each designation, and their criteria, differ. The high overlap suggests that many of the criteria used to designate communities are correlated.

Table B shows correspondents between the WFSVI and the J40 designation. These two designations also exhibit substantial overlap (80%).

Table C shows that the J40 and CO EnviroScreen designations correspond for 77% of CBGs in Colorado. Notably, there are no CBGs designated under J40 that do not meet the CO EnviroScreen criteria because J40 CBGs automatically qualify as CO EnviroScreen disproportionately impacted communities.

We reiterate that a CBG qualifies for reduced match in the FRWRM program if it meets any of these three designations.

A. CO EnviroScreen | WFSVI Alignment
CO EnviroScreen
Not DIC
Not 2176 842
WFSVI Qualify 153 851
B. J40 | WFSVI Alignment
J40
Not J40
Not 2732 294
WFSVI Qualify 488 521
C. J40 | CO EnviroScreen Alignment
J40
Not J40
Not 2329 0
DIC 889 804

Figure 1: Fraction of county CBGs deemed disadvantaged or impacted by WFSVI, CO EnviroScreen, or J40. Note that number of CBGs in each county varies substantially. The bar opacity is proportional to the number of CBGs in the county (darker = more CBGs).

Figure 1 shows how these three designations are distributed across counties in Colorado. All of the CBGs qualify for at least one designation in several rural counties in Colorado. While these counties may span a large area, they are not very populated and have relatively few census block groups.

Limitations

American Community Survey data is based on a sample with a reported margin of error. The COVID-19 pandemic impacted trends and affected the ability to collect data due to sampling challenges. The U.S. Census Bureau reported that, due to the difficulties of fielding a household survey during the COVID-19 pandemic, household nonresponse increased substantially in the ACS, with evidence of increased nonresponse bias in many statistics. These challenges largely apply to the 1-year ACS estimates and are less of a concern for the 5-year estimates. However, these inaccuracies and high margins of errors may lead to inaccurate classifications. It may take some time before the full impact of the pandemic on census data accuracy is fully understood. It is also important to note that the margin of error may be significant in small census block groups. We acknowledge the potential that the data may be inaccurate. However, the ACS is the most reliable data to calculate the WFSVI.

References

Steven Manson, Jonathan Schroeder, David Van Riper, Tracy Kugler, and Steven Ruggles. IPUMS National Historical Geographic Information System: Version 16.0 [dataset]. Minneapolis, MN: IPUMS. 2021. http://doi.org/10.18128/D050.V16.0

Footnotes

  1. Multiple block groups are nested within tracts.↩︎